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An  Ontology  of  Physical  Actions 


Ernest  Davis 


1.  iDtrodudloD 

This  paper  presents  a  fonnal  ontology  and  langxiage  for  representing  knowledge  about 
actions  involving  physical  objects.  Our  ultimate  aim  is  to  develop  a  knowledge  base  manager  to 
perform  the  inferences  required  a  robot  who  uses  tools.  The  following  questions  might  be  typical 
of  those  to  be  presented  to  our  knowledge  base  manager. 

a)  How  can  the  robot  hang  a  hanger  on  a  hook? 

b)  Will  a  saeen  with  a  large  hole  keep  out  flies? 

c)  Which  of  the  available  tables  will  hold  drinks  at  a  convenient  level  next  to  the  sofa? 

d)  How  can  a  one-handed  robot  carry  four  books,  a  pencil,  and  a  pendl  sharpener  from  one 
place  to  another  if  the  available  tools  are  a  ladder,  a  box,  and  a  wheel? 

e)  What  kind  of  hammer  claw  is  needed  to  remove  a  tack  hammered  into  the  wall  one  millime- 
ter above  the  floor? 

f)  How  can  a  robot  with  only  sonar  find  his  way  to  the  door  without  scraping  the  walls?  Sup- 
pose he  has  equipped  with  felt-covered  bumpers,  so  that  he  is  allowed  to  scrape  the  walls? 

The  basic  components  of  our  problems  are  a  robot,  who  consists  of  a  body  and  sensors;  a 
starting  scene,  with  specific  objects  in  specific  places;  an  objective  to  be  achieved;  a  number  of 
physical  constraints  (e.g.  the  robot  cannot  go  through  walls;  the  robot  cannot  disconnect  his  own 
hand);  a  number  of  imposed  constraints  (the  robot  is  not  allowed  to  rub  against  the  walls);  and  an 
action  which  the  robot  is  to  carry  out.  In  general,  a  problem  specifies  some  of  these,  and  poses  the 
problem  of  finding  the  rest.  For  example,  in  (a),  (d),  and  (f)  we  are  required  to  find  appropriate 


actions.  In  (b)  we  are  asked  whether  a  given  object  will  serve  a  given  objective.  In  (c)  and  (e)  we 
are  asked  to  find  or  design  a  particular  object  for  a  particular  objective. 

Tliis  is  a  study  in  naive  physics,  similar  to  [Bundy,  83],  [Forbus,  83],  or  [Kuipers,  82].  How- 
ever, the  above  problems  require  much  deeper  spatial  representation  and  reasoning  than  is  found 
in  the  naive  physics  literature.  We  will  study  the  interface  between  spatial  and  physical  representa- 
tions in  detail  in  subsequent  papers.  This  paper  presents  only  the  ontological  primitives  needed  for 
the  domain,  in  the  style  of  [Hayes,  79],  [McDermott,  82],  or  [Moore,  80]. 

We  begin  with  the  basic  ontology  of  modelling  physical  space  in  terms  of  /?'  and  time  in 
terms  of  R ,  and  then  we  define  these  more  complex  concepts  in  terms  of  these  using  the  language 
of  sets  and  functions.  Simultaneously,  we  build  up  the  primitives  of  a  first  order  language,  and 
indicate  how  we  could  use  the  language  to  express  the  knowledge  which  we  wish  to  incorporate 
into  our  system.  For  the  time  being  we  will  slough  over  the  essential  question  of  what  kinds  of 
geometric  primitives  are  needed  and  simply  help  ourselves  to  any  geometric  primitive  in  the 
mathematical  literature.  Future  papers  will  consider  the  problem  of  forming  a  geometric  represen- 
tation for  this  system. 

2.  Scope 

We  impose  three  basic  restrictions  on  the  scope  of  our  problem.  Rrstly,  we  consider  only 
rigid  objects,  not  flexible  or  fluid  objects.  We  describe  a  jointed  objects  as  a  set  of  rigid  objects 
whose  positions  are  restricted  by  physical  constraints.  Secondly,  we  consider  only  actions  whose 
effect  is  essentially  independent  of  the  speed  at  which  they  are  p)erformed.  Thus,  pushing,  carry- 
ing, or  blocking  actions  would  be  included  but  hitting  a  baseball  or  intercepting  a  missile  would 
not.  Thirdly,  we  consider  only  fixed  numbers  of  objects,  not  sets  of  objects  of  undetermined  car- 
dinality. These  restrictions  very  much  simplify  the  problem,  while  stiU  leaving  a  very  large  class  of 
cases.  Most  of  the  situations  which  have  been  considered  in  the  study  of  robotics  fall  into  these 
classes. 

Qven  the  restriction  to  rigid  objects,  why  do  we  not  simply  use  Newtonian  physics,  with  its 
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great  power?  The  truth  is  that  an  analysis  in  terms  of  forces,  energy,  and  momentum  is  often  both 
unnecessary  and  insufficient.  For  example,  if  we  wish  to  predict  what  happens  to  books  in  a  box  if 
a  box  is  moved,  it  is  impossible  to  say  exactly  what  horizontal  forces  will  be  applied  to  the  books 
when.  Nor  is  it  necessary;  we  know  that  the  books  will  remain  in  the  box.  For  another  example,  if 
a  book  rests  on  a  table,  Newton's  laws  do  determine  that  the  book  will  stand  still,  but  the  deriva- 
tion is  not  easy,  and  a  much  simpler  analysis  of  the  situation  will  suffice. 

We  choose,  instead,  to  go  to  the  opposite  extreme  and  consider  only  cases  which  can  be 
analyzed  without  any  laws  depending  on  time  measurement.  The  primary  law  wWch  we  will 
depend  on  is  that  two  hard  objects  cannot  overlap.  In  this  limited  view,  we  analyze  "A  pushing  B" 
as  follows.  For  some  reason  A  is  "trying"  to  go  forward.  However,  B  is  in  front  of  A,  so  A  cannot 
simply  move  forward,  leaving  the  rest  of  the  world  unchanged.  Rather,  if  at  all  possible,  the  world 
accomodates  itself  to  A's  attempt  while  preserving  the  constraint.  This  is  done  by  B  moving  for- 
ward. If  B  cannot  move  forward  (say  it  is  glued  to  the  ground)  then  A's  attempt  is  not  successful. 
The  remainder  of  the  paper  is  basically  the  development  of  a  system  in  which  the  above  analysis 
can  be  expressed. 

Two  further  restrictions  on  the  scope  of  this  enterprise  should  be  noted.  The  general  prob- 
lem of  moving  rigid  objects  around  rigid  barriers  is  very  difficult.  (See  [Schwartz  and  Siarir,  81], 
[Lozano-Perez,  81]  and  [Brooks,  82].)  For  our  purposes,  we  are  not  looking  for  exact  or  complete 
algorithms,  merely  for  quick  usable  heuristics.  The  other  restriction  is  that  we  wish  to  avoid  prob- 
lems requiring  sophisticated  planning;  in  particular,  those  raised  by  interacting  goals.  (See,  for 
example,  [McDermott,  to  appear],  [Wilensky,  80],  or  [Sacerdoti,  75].) 

Many  of  the  definitions  and  axioms  below  are  formulated  in  predicate  calculus  mixed  with 
set  theoretic  notation.  These  should  be  self-explanatory.  Let  me  merely  make  the  following 
remarks  as  to  notation: 

a)      Binary  boolean  operators  (and,  or,  implies,  iff)  and  the  primitive  relations  "=",  "^",  "^" 
"{J",  "H"  ^d  "t"  (element)  are  infix.  All  other  predicates,  including  "subset",  are  prefix. 


b)  Functions  and  relations  are  indicated  in  the  normal  mathematical  style  f(x)  rather  than  in  the 
LISP  style  (/"  jc).  In  cases  where  /  is  itself  a  complex  expression,  we  will  either  write 
"applyC/"^)"  or  invent  a  notation  suggestive  of  the  type  of/. 

c)  Indentation  is  used  extensively  for  grouping.  Where  this  is  unclear,  I  have  added  parentheses 
and  brackets.  Curly  brackets  "{}"  are  used  exclusively  for  set  notation. 

d)  I  used  a  typed  logic,  where  the  type  of  variable  is  indicated  by  the  first  letter.  T  is  used  for 
times;  S,  for  scenes;  H  for  histories;  A,  for  actions.  Also,  I  use  quantification  in  sets,  "forall 
(XtS)PiX)"  means  "forall  (X)  [  (X^)  impUes  P(X)  ]" 

e)  Any  variable  which  is  not  explicitly  quantified  is  assumed  to  be  universally  quantified. 

f)  Where  predicate  calculus  would  be  complicated  and  unhelpful,  I  have  stuck  to  English. 

3.  Basics 

We  begin  with  a  number  of  basic  definitions. 

The  building  blocks  of  our  system  are  subsets  of  three-dimensional  space  (/?').  Since  there  is 
no  standard  term  for  these,  we  will  call  them  bodies. 

DeflnitioD  3-1: 

A  body  is  a  closed,  bounded  subset  of  /?'. 

The  dosedness  condition  is  purely  formal,  to  simplify  some  of  the  axioms  and  definitions 
below.  Boundedness  and  connectedness  are  physically  plausible,  and  simplify  the  exposition. 

We  assume  the  existence  of  a  set  of  distinguishable  objects.  We  might  be  tempted  to  identify 
an  object  with  the  body  it  occupies,  or,  since  objects  can  move  around,  with  the  set  of  all  bodies  it 
can  occupy  in  different  positions.  This  is  not  adequate,  however,  since  it  does  not  distingiiish 
between  different  congruent  embeddings  of  a  symmetric  objects.  For  example,  we  would  not  be 
able  to  describe  a  cylinder  spinning  around  its  axis.  Rather  we  define  the  shape  of  an  object  O  in 
terms  of  a  standard  position,  written  stand{0),  which  is  a  body.  Then  we  describe  all  other  posi- 
tions of  the  object  as  rigid  mappings  which  take  stand  (O)  into  some  other  congruent  body. 
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Axloni  3-1: 

For  each  object  O,  stand  (O)  is  a  body. 

DeflnitloD  3-2: 

A  mapping  is  a  sense-preserving  (i.e.  no  reflections)  rigid  transformation.  Given  a  mapjping 
M  and  a  point  set  P,  we  write  "image(A/^)"  as  alternate  notation  for  M(P). 

We  now  define  a  scene  to  be  an  arrangement  of  objects.  The  positions  of  an  object  in  a 
scene  is  defined  in  terms  of  a  mapping  from  its  standard  position. 

Definition  3-3: 

A  scene  is  a  function  from  a  set  of  objects  onto  mappings  (1  mapping  per  object).  Given  a 
set  of  objects,  U,  we  write  "scene(5,(/)"  to  mean  that  5  is  a  scene  with  domain  U. 

Some  useful  notation  with  scenes: 

Deflnltion  3-4: 

Qven  a  set  of  objects  U,  a  scene  5  with  domain  U,  an  object  O  in  U,  and  a  subset  P  of 
stand(O), 

a)  sceneniapping(5,0)"S(0),  the  mapping  which  locates  O  in  5. 

b)  sceneplace  (P,0,S)^  image  (5(0)  J')  the  image  of  P  under  the  mapping  S(0). 

c)  place  (0,S)^  sceneplace  (stand(0),0^),  the  point  set  occupied  by  O  in  scene  S. 

The  sceneplace  function  may  be  used  to  describe  the  location  of  a  subset  or  point  in  aii 
object  in  a  scene.  Moreover,  since  a  rigid  mapping  has  a  unique  extension  from  O  to  the  rest  of 
R^,  sceneplace  may  also  be  used  to  locate  a  conceptual  point  outside  the  object  which  moves 
together  with  the  object.  For  example,  we  can  use  it  to  name  the  position  of  the  opening  of  a  bot- 
tle or  the  position  of  the  apex  extrapolated  from  an  object  whose  shape  is  the  frustum  of  a  cone. 

Qearly,  any  possible  position  for  an  object  is  equally  valid  as  the  standard  position.  A 
change  in  the  standard  position  of  an  object  merely  requires  a  change  in  the  mappings  associated 
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with  a  scene. 

Most  physical  reasoning  involves  histories,  in  the  sense  of  [Hayes,  78]:  chunks  of  space- time 
which  can  be  isolated  for  contemplation.  Because  of  the  way  we  have  defined  scenes,  our  formal 
definition  of  histories  differs  slightly  from  his.  We  define  a  history  as  a  continous  function  from 
time  to  scenes.  (We  identify  time  with  the  real  line.)  Thus,  there  might  be  a  three  minute  history 
in  which  the  robot  paced  back  and  forth  in  the  room.  The  history  would  specify  the  position  of  all 
limbs  and  all  other  objects  in  the  room  at  each  instant  of  time  in  the  three  minute  period. 

Deflnitioo  3-5: 

Given  a  set  of  objects  U  and  an  interval  of  time  /  either  of  form  [T^  Tj  or  of  form  [T^  inf), 
H  is  a  history  of  U  during  /  if  //  is  a  continuous  function  from  /  to  scenes  over  U.  (The  topology 
on  scenes  is  the  obvious  one.)  If  //  is  a  history  of  U  over  /,  we  write  formally,  "lastory(H ,U J)" , 
"1=  duration(^)",  and  "U=  objects(H)".  For  any  time  r  in  /,  H(T)  designates  the  scene  at  time 
T. 

A  few  obvious  and  useful  definitions. 

DeflnltioD  3-6: 

scenes  (H)  is  the  set  of  scenes  wWch  occur  b  H. 

Formally,  scenes  (H)=  {  H(T)\Tt  duration  (//)  } 

DefloltioD  3-7: 

H  is  u\finite  if  its  duration  is  infinite  on  the  right. 

Formally,  infinite(//)  iff  exists  {T^){[T^,mf)=  duration  {H)) 

Definition  3-8: 

startscene(//)  is  the  first  scene  in  R  ' 

Formally,  startscene(//)«!f/  (lowerbound  (duration  {H))). 

Definition  3-9: 
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endscene(//)  is  the  last  scene  of  a  finite  history  H. 

Formally,  if  not  (infinite  (//))  then  endscene(//)=//  (i^jperbound  (duration  (//))). 

Definition  3-10: 

A/  is  a  subhistory  of  7  if  it  is  a  restriction  of  /  to  a  subset  of  the  time  interval. 

Formally,    subhistory(//,y)    iff    subset    (duration    (//),    duration    (7))    and   forall    (7   c 
duration(//))//(r)=y(r). 

Definition  3-11: 

An  instantaneous  history  is  one  which  takes  no  time. 

Formally,  instantaneous(//)  iff  exists  (T)  [TJ]  =  duration  (H). 

DeOnidoD  3-12: 

hsequencc(f/i  7/2)  '^  *^  history  consisting  of  Hy  and  H^  in  sequence.  If  ^j  is  infinite,  then 
hsequence(//i  //j)  is  just  H^.  Formally, 

H=  hsequence  (H-^H^)  iff  exists  (Ti  Tj  J3) 

[  not  infinite  (H{)  and  duration  (W)  =  [7"i  Tj]  and 

duration  (H^-^=[T^T^  and  duration  (H^  =  [Tj/j]  and 

forall  (T)[(T^'ST^T2)  implies  H(T)=H^(T)]  and 

forall  (T)[(T2'ST^Ti)  implies  H{T)=H2{T)]  ]  or 
[  infinite  (//j)  and  H^H^] 

Theorem  3-1: 

If //=hsequence(Wi//2)  then  endscene(//i)=  startscene(//2) 

By  abuse  of  notation,  we  use  hsequence  with  more  than  two  arguments  to  indicate  sequenc- 
ing of  many  histories. 

Definition  3-13: 

iisequence  {H-^fli^i  '  '  '  ^n)=  hsequence(//i,  hsequence(//2  •  •  •  )) 
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Deflnltlon  3-14: 

initial  (H^,  H)  iff  exists  {H^  [H  =  hsequence(//i^2  )] 

//,  is  an  initial  part  of  H. 

Definition  3-15: 

endhistory  {Hi^)  iff  exists  {H^)  [H  =  hsequence  {H^^H-^] 

Hi  is  a  final  part  of  H. 

The  condition  we  placed  on  our  physics,  that  all  actions  can  be  performed  at  an  arbitrary 
rate,  means  that  the  time  dependence  of  a  history  is  essentially  irrelevant.  Two  histories  H^  and  W-, 
can  be  considered  equivalent  if  the  scenes  of  one  can  be  mapped  monotonically  into  the  scenes  of 
the  other.  We  do  not  allow  stops  to  be  inserted;  thus,  the  relation  between  the  histories  is  one- 
one. 

Deflnltioo  3-16: 

Hstories  H,  and  H^  are  equivalent  under  changes  of  time  metric,  written  hequiv{Hy  H-^  iff 

a)  objects  (//;)  =  objects  (//j)  =  objects  {H^); 

b)  There  exists  a  continuous,  one-one,   monotonically  increasing  function  /  from  duration(//J 
to  duration(//2)  such  that  forall  (reduration(//i))  //,(r)=^2(/"(r)) 

f)      either  H-y^2  ^^  t>o*  ^^^^^  or  they  are  both  infinite. 

As  long  as  we  restrict  attention  to  circumstances  which  respect  the  equivalence  condition,  we 
can  replace  most  explicit  references  to  time  by  uses  of  subhistory,  initial,  and  hsequence. 

The  trace  of  an  object  through  a  history  is  the  history  restricted  to  that  single  object.  The 
motion  of  an  object  through  a  history  is  its  sequence  of  positions  relative  to  the  starting  point. 
Thus,  if  W  is  the  history  of  object  0  moving  from  <1,  0,  0>  to  <2,  0,  0>  and  object  P  rotating 
about  its  axis,  then  trace(0,ff)  is  the  history  of  O  moving  from  <1,  0,  0>  to  <2,  0,  0>,  and 
motion(C>//)  is  the  function  "move  one  unit  in  the  X  direction". 

DeflnitioD  3-17: 
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trace(0//)=/  iff 
objccts(/)={0},  duration(/)=duration(//),  and 

foral](rc  duration(//))  (scenemappmg(/(r),0)  =  sceneraapping(//(r),0). 
Definition  3-18: 

motion(0^)=M  iff 
apply  (A/(7)  ,sceneraapping(startscene(//)  ,0)) = scenemapping(//(r)  ,0) 
Finally,  we  fix  a  notational  cxjnvention  for  convenience.  Most  of  our  geometric  terms  are 
defined  on  bodies,  but  are  applied  to  objects  in  a  scene.  So  strictly,  we  would  continually  find  our- 
selves writing 

geometric_term{place{0i,S)j>lace{02,S)  ■  ■  ■  place {0„,S)) 
We  will  abbreviate  all  such  expressions  as  geometric _term{0 ^,62  ■  ■  ■  0„,S).    For  example,  if  we 

have  defined  abut{B.,B2)  to  mean  that  bodies  flj  and  Bj  have  intersecting  boundaries,  then  we  can 

write  abut{0^,02,S)  to  mean  that  the  places  of  objects  Oj  and  O2  abut  in  scene  S. 

4.  Constraints 

The  next  problem  is  to  represent  constraints.  So  far,  a  scene  can  be  any  set  of  mappings  at 
all,  and  a  history  can  be  any  continuous  function  onto  scenes.  We  must  have  a  mechanism  for  rul- 
ing out  many  of  these  as  physically  impossible.  We  use  constraints  to  defme  which  histories  are 
consistent  with  physical  laws.  Constraints  can  also  be  used  to  limit  histories  in  ways  more  specific 
than  the  general  physical  laws;  in  particular,  to  express  physical  constraints  associated  with  specific 
sitiiations,  and  restrictions  imposed  on  the  problem  solver.  An  example  of  the  former  would  be  a 
joint  connecting  two  limbs,  which  restricts  their  relative  positions  in  a  particular  way.  Here  the 
constraint  rules  out  histories  which  take  the  objects  into  excluded  positions.  An  example  of  an 
imposed  restriction  would  be  a  rule  that  the  robot  cannot  allow  any  object  to  drop.  Here  the  con- 
straint rule  out  any  history  where  any  object  drops. 

Formally,  a  constraint  is  a  set  of  histories;  those  which  satisfy  the  constraint.  We  note  that  if 
a  history  occurs  then  all  its  subhistories  occur  and  hence  must  also  satisfy  the  constraint.   We  also 
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require  that  our  constraints  be  dosed  under  temporal  equivalence.  Finally,  we  require  that  con- 
itraints  be  have  no  memory;  that  is,  whether  a  sequence  of  events  is  allowed  by  a  constraint 
depends  only  on  the  state  of  the  world  during  the  events,  and  not  on  previous  history.  This  can  be 
stated  formally  as  the  requirement  that  if  two  histories  satisfy  the  constraint,  and  they  can  be  con- 
catenated then  their  concatenation  is  in  the  constraint. 

DeflnldoD  4-1: 

A  constraint  C  is  a  set  of  histories  such  that 

a)  if  //  is  in  C  and  /  is  a  subhistory  of  H  then  /  is  in  C; 

b)  \iH  is  in  C  and  hequiv  (///)  then  /  is  in  C. 

c)  if  ^  is  in  C  and  /  is  in  C  and  endscene  (//)  =  startscene  (/)  then  hsequence  (//,/)  is  in  C. 

A  number  of  specific  constraints  are  particularly  significant.  These  include  the  constraint  that 
hard  objects  don't  overlap;  the  constraint  that  only  animate  objects  are  capable  of  spontaneous 
motion  (a  law  of  naive  physics,  at  least  in  some  contexts,  though  not  a  law  of  "real"  physics,  and 
an  approximation  often  made  in  robot  planning);  and  the  law  of  gravity.  We  may  formally  defme 
the  constraint  on  hard  objects  as  a  set  of  histories  as  follows:  The  most  basic  constraint  is  the 
disaeteness  of  hard  objects:  hard  objects  do  not  overlap.  This  constraint  is  called  hardobjs  and 
may  be  defined  as  follows: 

DeflnltioD  4-2: 

hardobjs  ■  {  //  |  forall  (0^,0^  objects(W),  5c  scenes(H))  overlap(Oi  02,5)  implies  0^=02} 

Overlap ,  used  above  means  that  two  bodies  have  overlapping  interiors 

Definition  4-3:  Given  two  bodies  B^  and  B2,  overlap(fli32)  ^^  interior(fli)  intersects 
interior(52),  where  interior  is  taken  in  the  strict  topological  sense.  (The  interior  of  a  box  is  inside 
the  cardboard,  not  in  the  air  surroimded  by  the  box.) 

We  defer  the  formal  definitions  of  the  constraint  that  inanimate  objects  do  not  move  spon- 
taneously, and  the  law  of  gravity  to  section  9  on  account  of  their  complexity. 
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Physical  constraints  occupy  a  different  logical  status  in  planning  than  non-physical  contraints. 
The  robot  must  work  to  maintain  imposed  constraints,  while  physical  constraints  maintain  them- 
selves. This  distinction  becomes  important  in  defining  feasibility  of  actions  (see  section  6). 

We  may  treat  a  set  of  physical  constraints  as  a  single  constraint  whidi  is  the  intersection  of 
the  various  constraints  in  the  set.  We  will  use  this  abbreviation  to  simplify  the  exposition  below. 

5.  Senses 

We  presume  that  the  robot  is  equipped  with  sensors  which,  under  specified  conditions,  make 
certain  measurements.  Measurements  may  be  other  than  real  valued;  for  example,  a  boolean 
valued  measurement  corresponds  to  verifying  a  fact.  Sensors  are  of  two  kinds.  There  are  scene- 
sensitive  sensors,  which  measure  quantities  in  a  scene;  and  there  are  history-sensitive  sensors, 
which  measure  quantities  in  a  history.  For  example,  a  gasoline  gauge  is  a  scene-sensitive  sensor 
while  a  speedometer  or  an  odometer  is  a  history-sensitive  sensor.  In  this  paper,  we  will  deal 
exclusively  with  scene-sensitive  sensors. 

Abstractly,  a  sensor  is  a  function  on  scenes.  We  will  allow  the  value  of  a  sensor  function  to 
be  any  type  of  mathematical  object.  All  sensors  can  sometimes  retxim  the  value  "undefined",  in 
cases  where  the  sensing  cannot  be  performed.  Given  a  sensor  Q  and  a  scene  5,  we  say  that  Q  is 
detectable  in  5  if  C  (5)  =!t  undefined. 

For  example,  let  C  be  an  electric  eye  with  source  X  and  receptor  Y  (both  source  and  recep- 
tor assumed  to  be  point  objects).  Q{S)  is  the  boolean  predicate  "there  is  some  object  which  inter- 
sect the  line  segment  <sceneplace(X,(3,5)  --  sceneplace(K,2,5)  >".  (Note  that  we  are  here  con- 
founding the  sensor  Q  with  the  physical  object  with  which  it  is  associated.)  For  another  example, 
if  0  is  a  two-dimensional  camera  eye  in  a  world  of  unknown  black  objects  against  a  white  back- 
ground, then  C(5)  is  the  projection  of  the  objects  in  the  world  against  the  plane  of  Q,  a  subset  of 
R^.  As  the  camera  becomes  more  sophisticated,  the  world  becomes  more  varied,  and  more  prior 
knowledge  is  available,  the  value  of  Q(S)  becomes  more  complex. 

As  with  constraints,  a  set  of  sensors  Ci,  •  •  •  C„  can  often  be  considered  as  a  single  sensor  Q 
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which    returns    all    of    the    results    of    the    separate    sensors    combined    into    a    tuple: 
G(5)=<(2i(S),G2(5)  •  •  •  Q„(S)>. 

A  robot  is  defined  as  a  class  of  sensors  plus  a  class  of  objects  which  constitute  its  body. 

6.  Actions 

An  action  is  something  that  an  actor  can  do  in  a  given  situation  to  make  things  happen.  An 
actor  can  bring  it  about  that  certain  histories  occur  and  others  do  not.  However,  his  control  over 
the  universe  is  limited;  he  can  cause  certain  things  to  happen,  but  other  parts  of  the  universe  may 
pursue  activities  independent  of  him.  Therefore,  the  result  of  an  action  in  a  particular  scene  is  a 
set  of  histories  compatible  with  that  action.  We  may,  in  fact,  identify  the  action  with  all  the  his- 
tories which  are  compatible  with  that  action  in  any  starting  scene.  The  result  of  an  action  in  a 
given  scene  is  simply  that  subset  which  begins  with  the  particular  scene. 

This  definition  is  somewhat  non-intuitive,  so  it  is  worth  elaborating.  We  might  naturally  rea- 
son that,  when  you  perform  an  action  in  a  scene,  some  spedfic  thing  happens,  which  would  sug- 
gest a  definition  of  action  as  a  function  which  takes  a  scene  into  a  history.  This  is  not  acceptable, 
for  several  reasons.  We  note  that  the  resulting  history  depends,  not  only  on  the  scene  but  also  on 
the  active  physical  constraints.  Quite  different  things  will  result  from  the  action  of  trying  to  lift  the 
handle  of  a  suitcase  in  the  cases  where  (a)  the  handle  is  not  attached  to  the  suitcase,  (b)  the  han- 
dle is  attached,  and  (c)  the  handle  is  attached  to  the  suitcase,  but  the  suitcase  is  glued  to  the 
ground.  We  might  then  modify  our  definition  of  an  action  as  a  function  which  takes  a  scene  and 
a  set  of  constraints  as  input,  and  a  history  as  output.  But  the  function  is  of  a  very  well  behaved 
kind;  the  history  must  begin  with  the  scene,  and  must  be  an  element  of  the  set  of  constraints.  This 
suggests  defining  the  action  as  simply  the  union  of  all  the  possible  results  under  all  possible  sets  of 
constraints.  We  can  then  define  the  effects  of  starting  in  a  scene  or  obeying  physical  constraints  as 
restrictions  on  that  set.  .  i 

DefinitioD  6-1: 

An  action  is  a  set  of  histories. 
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Definition  6-2: 

Given  an  action  A  and  a  scene  5,  results(i4  JS)  "  {H  \  HtA  and  startscenc(//)='S  }  (read  "the 
results  of  A  in  S") 

Note  that  this  definition  of  action  is  more  general  than  the  state-space  definition  of  action  as 
a  function  from  states  to  states,  in  that  it  allows  "run  around  the  track  three  times"  as  a  possible 
action.  It  is  less  general,  but  rather  more  concrete,  than  the  analysis  of  action  of  [McDermott,  82], 
in  which  "action"  is  allowed  to  include  preventing,  thinking,  noting,  etc. 

We  allow  impossible  actions.  We  allow  the  action  'lower  the  book  3  feet"  even  if  the  book  is 
lying  on  the  desk,  and  the  desk  is  fixed.  The  result  is  simply  a  history  of  the  book  going  through 
the  desk.  This  is  impossible  but  not  undefined.  Our  definition  of  an  action  being  "feasible"  below 
captures  this  sense  of  impossibility.  Meanwhile,  it  simplifies  many  definitions  if  we  define  actions 
as  broadly  as  possible. 

DefinltloD  6-3: 

A  situation  is  an  ordered  pair  of  a  scene  and  a  physical  constraint. 

DeflnitioD  6-4: 

The  possible  results  of  an  action  A  in  a  situation  <S,C>, 

posresults(A,5,C)={Hl//eA  nc  and  startscene(f/)=5  } 

The  feasibility  of  an  action  depends  on  the  starting  scene,  the  physical  constraints,  the  avail- 
able sensors,  and  the  class  of  objects  that  you  control  directly.  Actions  which  violate  the  physical 
constraints  are  said  to  be  physically  infeasible.  Those  which  require  information  undetectable  by 
the  sensors  are  called  episteraically  infeasible. 

Physical  feasibility  depends  only  on  the  extension  of  the  action  --  that  is,  on  the  set  of  his- 
tories which  is  the  action  --  and  on  the  situation,  the  combination  of  the  starting  scene  and  the 
assumed  physical  constraints.  An  action  is  physically  feasible  in  a  given  sitxiation  only  if  there  are 
some  histories  in  the  action  which  begin  with  the  scene  and  which  obey  the  constraints.  The 
assumption  is  that  the  world  will  accommodate  your  action  if  it  is  in  any  way  compatible  with  the 
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comtraints. 

However,  we  do  not  want  to  force  the  world  to  be  prophetic.  The  world  has  no  way  of  for- 
leeing  the  end  of  your  action  at  its  beginning;  it  can  only  be  accommodating  locally.  Therefore,  in 
a  condition  where  you  and  the  world  get  into  a  dead  end  •-  you  pursue  your  action  for  a  wiiile,  the 
world  does  something  compatible  for  a  while,  and  then  you  find  that  the  rest  of  the  action  is 
incompatible  with  the  current  state  of  the  world  --  the  original  action  must  be  judged  infeasible, 
even  if  there  is  something  else  the  world  could  have  done  which  would  have  allowed  your  action 
to  go  through.  We  therefore  impose  the  additional  condition  that  any  successful  beginning  of  the 
action  be  extendible  to  a  successful  completion. 

Definition  6-5: 

An  action  A  is  physically  feasible  in  a  situation  <S,C>  iff 

1)  posresu]ts(A , 5, C)  is  non-null;  and 

2)  for  eadi  history  H  in  results(;4 ,5),  if  /  is  an  initial  part  of  H  and  /  is  in  C  then  there  exists  a 
J  in  posresu]ts(A,5,C)  such  that  /  is  an  initial  part  of  J. 

An  action  is  epistemically  feasible  with  respect  to  a  sensor  Q  (representing,  perhaps  a  set  of 
sensors)  if  the  robot  can  use  Q  to  keep  his  motions  within  the  action.  We  will  first  define  the  spe- 
cial case  of  a  blind  action,  an  action  whidi  can  be  executed  without  any  sensors  whatever.  Sudi  an 
action  is  characterized  by  the  fact  that  the  motion  of  the  robot  is  entirely  unaffected  by  any  other 
object. 

DeflnitioD  6-6: 

An  action  A  of  robot  R  is  blind  iff 

forall  (H^iA^2)  [niotion(R,H{)=mohon(RJi2)  implies  Wjt^i]- 
(Strictly  speaking,  since  the  robot  may  have  multiple  body  parts,  we  should  quantify  over 
objects  which  are  part  of  the  robot.  However,  we  will  write  our  definitions  as  if  the  robot  was  a 
single  object  for  simplicity.) 

Thus  whether  a  history  is  in  A  is  determined  wholly  by  the  motion  of  the  robot  in  R.  Note 
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that  this  property  is  only  true  of  the  action  as  a  whole;  it  does  not  apply  when  the  action  is  res- 
tricted by  physical  constraints.  For  example,  if  the  action  is  "move  two  feet  forward"  and  the  con- 
straint that  hard  objects  do  not  overlap  applies  then  the  motion  of  other  objects  is  not  independant 
of  the  motion  of  the  robot;  if  they  are  in  its.  way,  it  will  p\ish  them.  But  considering  performances 
of  the  action  under  all  pxjssible  physical  laws,  the  action  does  include  histories  where  the  objects 
stand  still,  and  the  robot  walks  through  them. 

To  include  sensors,  we  must  allow  the  robot  to  adjust  his  motions  according  to  what  he 
detects  in  the  outside  world.  We  therefore  weaken  the  above  definition  as  follows.  K  a  given 
motion  is  permitted  in  one  set  of  circumstances  and  not  m  another,  then  the  difference  between 
the  circumstances  must  be  detectable  by  the  sensors.  Moreover,  a  detectable  difference  must  arise 
no  later  than  the  forbidden  motion  "becomes"  forbidden.  We  can  formalize  this  as  follows: 

Definition  6-7: 

An  action  A  by  robot  R  is  epistemically  possible  under  sensor  Q  iff 
forall(//,t/i//2) 
[[  not  iH2tA)  and  motion(/?^,)=motion(/?,W2)]  implies 
exist  (71,^2'^) 

[initial(yi//i)  and  initialC/jr^j)  and  \mtia\(J2J)  and  ItA  and 

motion(/?,y.)=motion(i?,y2)  and  G(endscene(yi))  =jt  C(endscene(y2))  ]] 
For  example,  let  C  be  an  action  which  can  detect  the  position  of  object  A  in  some,  but  not 
all  positions.  Then  the  action  "if  Q(S)  is  not  undefined,  move  halfway  toward  A ;  else,  stand  stiU" 
is  epistemically  possible.  If  the  motion  of  the  robot  ends  up  different  in  two  histories,  it  is  either 
because  A  was  detectable  in  one  and  not  the  other,  or  because  A  was  detectable  in  both  and  had 
different  positions  relative  to  the  robot.  The  unqualified  action  "move  halfway  toward  A"  is,  in 
general,  epistemically  infeasible,  because  there  will  be  two  starting  scenes  where  the  position  of  A 
is  different  but  undetartable.  The  required  motion  in  these  two  scenes  must  be  different,  and  the 
sensor  is  not  adequate  to  guide  this  difference. 
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It  is  interesting  to  contrast  this  treatment  of  qjistemic  feasibility  with  that  in  [Moore,  80]. 
We  are  obviously  more  restricted  in  domain,  but  our  more  concrete  approach  allows  us  to  describe 
the  vviiys  and  wherefores  of  feasibility  in  cases  where  Moore  simply  adopts  ad  hoc  axioms.  For 
example,  Moore  uses  axioms  which  assert  that  a  given  action  produces  a  given  piece  of  knowledge; 
he  docs  not  give  a  mechanism  to  explain  why  an  action  would  be  associated  with  the  knowledge. 
Similarly,  it  is  an  axiom  in  Moore's  system  that  the  action  of  opening  a  safe  is  rigidly  designated 
by  the  specification  "turn  right  to  80  then  left  to  40  then  right  to  50"  but  not  by  the  specification 
"turn  right  to  the  first  number  of  the  combination,  then  left  to  the  second,  then  right  to  the  third". 
He  uses  this  axiom  to  prove  that  one  must  know  the  combination  before  opening  it.  This  level  of 
abstraction  gives  his  system  generality,  but  requires  a  lower  level  of  analysis  to  rest  on. 

Our  results  provide  such  support  in  our  domain.  In  the  vocabulary  we  have  developed,  we 
can  state  axioms  about  safes  wWch  would  allow  us  to  prove  such  result  as  "there  is  no  episterai- 
cally  possible  action  whidi  will  always  open  a  safe  of  unspecified  combination  in  3  turns,"  and 
"given  any  safe  of  specified  combination,  there  is  an  epistemically  possible  action  which  will  always 
open  it".  The  gap  here  our  concept  of  "unsp)ecified"  and  Moore's  concept  of  "unknown"  is  easily 
bridged.  Moreover,  we  are  in  a  position  to  prove  theorems  of  a  kind  difficult  in  Moore's  system 
such  as  "If  a  blinking  light  turns  on  whenever  the  correct  number  of  the  combination  is  reached, 
then  the  safe  can  be  opened  even  without  prior  knowledge  of  the  combination."  It  might  be 
worthwhile  to  try  to  combine  the  two  definitions  into  a  single  coherent  system. 

One  final  property  of  actions  is  determinism.  An  action  is  deterministic  if,  given  any  fixed 
behavior  of  the  surrounding  objects,  there  is  only  one  possible  behavior  for  the  robot.  We  first 
defme  two  histories  H  and  /  as  distinct  if  neither  H  nor  /  is  equivalent  to  any  subhistory  of  the 
other.  We  can  now  defme  a  non-deterministic  action  as  follows: 

Definition  6-9: 

An  action  A  of  robot  R  is  non-deterministic  iff 
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initial(yi^i)  and  initial(y2  Wj)  and  initial(/^i)  and  initial(/^2)  ^cl 

distinct(traoe(/?^i),trace(/?^2)  ^"^ 

foral](0)  (0=!t/?)  implies  trace(C>^j)=trace(0^2)) 
That  is  Wj  and  //j  start  out  the  same  in  I;  everything  else  stays  the  same  through  J-^  and  /j.  but  R 

does  different  things. 

7.  Objectives  and  Tasks 

In  the  most  genera]  terms,  an  objective  for  a  robot  is  to  force  some  class  of  histories  to 
occur.  This  could  include  such  objectives  as  "Run  around  the  block  three  times",  "Get  to  first  base 
before  the  ball",  or  "Swing  the  child".  Very  frequently,  the  objective  histories  are  distinguished  as 
ending  with  a  scene  of  a  particular  type;  it  doesn't  matter  how  they  go  as  long  as  they  end  up  in 
the  right  place.  Such  objectives  include  "place  the  book  on  the  shelf',  "attach  the  nut  to  the  bolt", 
and  "get  away  from  me". 

Often  such  desired  classes  of  scene  are  important  because  they  restrict  the  class  of  histories 
which  can  begin  with  them.  Three  very  common  functionalities  are  of  this  kind.  "holding(C>^)", 
where  O  is  an  object  and  H  is  a  dass  of  histories,  is  the  class  of  scenes  where  0  is  held  against 
actions  in  H;  that  is,  all  histories  in  H  starting  with  a  holding  scene  are  physically  impossible.  For 
example,  a  book  on  a  table  is  held  against  histories  beginning  with  a  downward  motion  (such  as 
falling  histories).  "fasten(0 />,////)"  means  that  O  is  fastened  to  P,  barring  histories  of  type  HH 
(unfastening  histories);  that  is,  all  subsequent  histories  must  either  be  of  type  HH  or  must  have  O 
and  P  within  some  maximum  distance.  "pTotecl(p ,U JfH)"  means  that  O  is  protected  against 
objects  in  dass  U  performing  histories  of  type  HH;  that  is,  no  history  of  type  HH  starting  in  a  pro- 
tected scene  will  cause  objects  in  f/  to  abut  object  O.  For  example,  a  scene  where  you  have  an 
umbrella  over  your  head  is  an  element  of  protect  (you,  raindrops,  histories  where  raindrop  move 
downward  and  you  do  not  lower  the  umbrella). 

A  task  for  a  robot  consists  of  an  objective,  a  set  of  active  physical  constraints,  a  dass  of 
starting  scenes  (the  robot  knows  he  is  in  one,  but  he  does  not  know  >niiich),  and  set  of  imposed 
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constraints  to  be  observed.  (Recall  that  the  robot  himself  consists  of  sensors  and  body.)  A  solution 
for  the  task  is  an  action  which  is  feasible  in  any  of  the  starting  scenes  and  all  of  whose  results 
from  any  of  the  starting  scenes  lies  within  the  objective.  This  is  the  motion  planning  problem.  It 
includes  such  problems  as  "Put  the  book  somewhere  off  the  floor  without  knocking  over  the  vase". 

A  design  problem  starts  with  an  objective,  a  set  of  physical  constraints,  a  starting  scene  and 
a  subspace  of  the  scene  representing  accessible  space.  A  solution  for  a  design  problem  consists  of  a 
new  object,  a  starting  place  somewhere  in  accessible  space,  and  a  plan  such  that,  when  the  new 
object  is  added  at  the  place  in  the  scene,  the  plan  will  be  feasible  and  will  achieve  the  objective. 
For  example,  we  might  be  presented  with  the  objective  of  supporting  a  coffee  cup  off  the  floor  in 
a  particular  comer  of  the  room.  A  solution  would  be  a  side  table  of  the  specified  size  and  shape,  a 
starting  place  somewhere  in  the  room,  and  a  plan  to  put  the  table  in  the  comer  and  to  put  the 
cup  on  the  table. 

8.  Net  Motions 

In  the  remainder  of  this  paper  we  will  use  the  semantics  developed  to  state  some  of  the 
"natural  laws"  of  naive  physics  in  terms  of  physical  constraints.  We  begin  by  borrowing  a  number 
of  ideas  and  terms  from  linear  algebra  to  describe  rigid  motions  of  objects.  We  must  first  define 
the  two  basic  motions,  translate  and  rotate. 

Definition  8-1:  For  any  vector  X,  translate(J^f)  is  the  function  mapping  a  vector  U  to  U-^X. 
In  lambda  notation,  translate(X)-X((/)(t/-l-X). 

To  defme  rotation,  we  need  some  preliminary  definitions: 

Definition  8-2:  A  direction  is  a  unit  vector. 

Definition  8-3:  A  directed  line  L  is  an  equivalence  class  of  pairs  <j:,m>  where  x  is  a  vector 
and  u  is  a  direction,  and  where  <jr,u>  is  equivalent  to  <y,v>  iff  u  =  v  and  >=x+m  where  r  is  a 
real  number.  If  <x,u>iL,  we  write  L=line(x,«). 

Definition  8-4:  Z,=line(j:,M)  and  M=)msiy,v)  an  parallel  iff  «=v  and  anti- parallel  if  «  =  -v 


(  sri;  .\-- 
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Deflnhioii  8-5: 

Given  a  line  Z,=line(x,u)  and  a  vector  Y,  \hc projection  of  Y  onto  L,  lproj(l'^)"x+(y •!/)«. 

Tht  perpendicular  from  Y  to  L,  perp(J'/,)"l'-lFOJ(^'^)- 

The  unU perpendicular,  uperp(y^)«  f^'^)j\\,,  • 

\]perp{JJL)\\ 

The  normal  of  Y  and  L,  norcaiYX)"  CTOss-prod(M,uperp(y^)). 

The  unit  normal.  unorm(yX)-  n"^"^?!^^?!,  • 

Definltioo  8-6:  Given  a  line  Z,  and  an  angle  9, 

rotate(L,e)-X(y)  OfoJ(I'X)+  I|perp(l'4-)l!(oos(e)  uperpCK^)  -I-  sin(e)unorm(yX)) 
Given  two  rigid  motions  R  and  5,  5/?=X(X)(5(/?(X))).  We  follow  the  analysts'  convention 
of  writing  the  functions  in  backwards  order  of  the  order  of  ^jplication  order.  The  inverse  of  a 
rigid  motion  R,  R~^  is  the  motion  such  that  RR~^=I,  the  identity  motion. 

The  rigid  motion  which  relates  the  positions  of  an  object  in  two  different  scene  is  called  the 
net  motion  from  one  scene  to  the  other. 

DefinltioD  8-7: 

Given  an  object  0  and  two  scenes  S^  and  52, 

net-motion(C>,5i,52)"Sceneniapping(OvS2)-  (sceneraapping(0^i))~^ 
Given  object  O  and  history  H, 

hnet-motion(0,//)"net-motion  (O.startscene  (^,endscene(//)). 
It  is  a  basic  theor^n  of  linear  algebra  that  any  rigid  motion  can  be  written  as  the  composi- 
tion of  a  rotation  and  a  translation. 

Theorem  8-1:  Given  any  rigid  motion  R,  there  exist  X,  L,  and  6  such  that 
/?=translate(X)rotate(L,9).  This  is  called  a  rotation-translation  decomposition  of  R.  We  write 
/f=rot-trans(XJL,6).  Two  decort^sitions  of  the  same  motion,  /?=rot-trans(i4X,6)=rot- 
trans(fl  ,Af,(D),  satisfy  the  foUowing  relations: 
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1)  Either  parallcl(L^  and  9=a)  mod  2it  or  anti-parallel(I.^  and  e=-(i)  mod  2ir 

2)  lproj(AX)=lproj(S^ 

It  is  alio  the  case  that  given  any  line  satisfying  (1)  above,  or  any  vector  satisfying  (2),  it  is 
possible  to  find  a  decomposition  of  the  motion  using  that  line  or  that  vector  (unless  9=0).  It  is 
often  useful  to  restrict  the  range  of  decompositions  being  considered  to  a  more  well-behaved  class. 
Generally  we  do  this  by  restricting  the  range  of  axes  of  rotation.  Sometimes  it  will  be  convenient 
to  oblige  the  axis  of  rotation  to  pass  through  a  specified  point,  such  as  the  center  of  mass.  Such  a 
constraint  imposes  a  unique  value  on  the  decomposition  (except  that  the  direction  of  the  line  may 
be  reversed).  A  more  flexible  constraint  is  that  the  line  of  rotation  pass  through  some  point  in  the 
convex  hull  of  the  object.  Such  a  decomposition  is  called  internal.  A  formal  definition  is  as  fol- 
lows: 

DeflnitioD  8-8: 

Given  an  object  O  and  two  scenes  5^  and  52,  a  triple  <AJ.,9>  is  an  internal  decomposition 
iff 

1)  rot-trans(/4  JL,e)  =  net-motion(0,5i  ^2);  and 

2)  L  intersects  the  convex  hull  of  place(0,5i). 

DeflnitioD  8-9:  Given  an  object  O  and  two  scenes  S^  and  52,  the  internal  translation  space  of 
the  motion  of  O  is  the  set  of  vectors  A  for  which  there  exists  L  and  9  such  that  <AJL,Q>  is  an 
internal  decomposition  of  the  motion  of  O. 

If  we  retrict  the  axis  of  revolution  to  the  center  of  mass  then  we  have  a  unique  decomposi- 
tion. The  translational  part  of  this  decomposition  is  simply  the  displacement  of  the  center  of  mass 
between  the  two  scenes.  Given  O,  S^,  and  52,  we  designate  this  decomposition 
cm -/notion  (0,5 1,52)  and  we  designate  its  translational  part  cm- translate  (OJSiJS  2).  Likewise, 
abusing  notation,  we  write  cm-motion(0/?)  and  cm-translate(O/0  ">  referring  to  motion  from 
the  starting  to  the  ending  scenes  of  a  history  H. 
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9.  More  Physical  Constraints 

In  this  section  we  will  investigate,  in  greater  depth,  typical  physical  constraints  which  arise  in 
our  domain.  We  have  already  discussed  the  "hard  objects"  constraint  in  section  4.  Another  com- 
mon constraint  is  that  only  animate  aeatiires  (in  which  we  Lodude  robots)  are  capable  of  spon- 
taneous movement;  other  objects  move  only  when  the  robot  is  in  direct  or  indirect  contact  with 
them.  This  constraint  is  of  course  not  true  even  in  the  most  naive  of  physics,  as  it  ignores  not 
only  inertia  but  also  falling.  However,  it  is  an  approximation  which  is  often  useful.  We  can 
express  this  constraint  as  follows: 

DefinitioD  9-1: 

aniniate_dri  ven  " 

{  H  I  forall(O)  [  movesin(0,//)  implies 
exists  {Sf.xeae&{ff)JR.) 

[aniniate{/?)  and  indirect_touch(/?,C>,objects(5),5)  ]] } 
What  this  definition  actually  states  is  that  if  O  moves  in  H  then  /?  is  in  indirect  contact  with 
O  at  some  point  within  H.  Since  histories  are  continuous,  it  follows  that  R  is  indirect  contact  with 
O  whenever  O  is  moving. 

Definition  9-1  relies  on  three  undefined  terms:  "movesin",  "animate",  and  "indirect_toudi". 
"Animate"  is  of  course  undefinable  within  our  theory;  it  is  simply  a  predicate  which  applies  to 
some  objects,  or  sets  of  objects,  and  not  others.  The  other  two  may  be  defined  as  follows: 

DeflnhioD  9-2: 

If  O  is  an  object  and  //  is  a  history  then 

movesin((?^  iff  exist  (SiJS^  xenes(H))  [scenemapping(0,,Si)#scenemapping(C)vS2 )] 
DeflnldoD  9-3: 

If  P  and  Q  are  bodies,  and  5  is  a  set  of  bodies,  then 

indirect_touch(P,e,5)  iff  exists  {B^=Pfi2,  '  '  '  B„=Q)  [  abuts  (BtJBi+^,i=l  to  n)] 
DeflnltioD  9-4: 
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If  P  and  Q  are  bodies  then  abuts(P,C)  iff  the  boundaries  of  P  and  Q  intersect,  and  their 
interiors  are  disjoint. 

The  constraint  "animate.driven"  is  quite  weak.  For  example,  it  allows  a  robot  to  slide  an 
object  along  his  body,  without  moving  any  of  his  body  parts,  or,  even  stranger,  to  touch  one  end 
of  a  row  of  blocks,  and  move  the  block  at  the  far  end  without  moving  any  of  the  blocks  in  the 
middle.  A  more  reasonable  constraint  would  be  that  the  motion  must  involve  a  chain  of  objects, 
starting  with  the  robot,  where  each  object  piishes  on  the  next.  We  call  this  constraint 
"push^driven"  and  define  it  as  follows. 

Definition  9-5: 

push_driven" 

{  H  I  forall  (0)  movesin(C>^)  implies 

exist(//',/?)  [subhistory(W  ^  and  animate(/?)  and  pushing(/?,C>,W)]} 
Pushing(/?,C>//')  means  that  R  was  pushing  O,  directly  or  indirectly,  throughout  the  subhis- 
tory  H' .  We  define  pushing  in  terms  of  chains  of  "direct  push"  as  follows: 

DeflnitioD  9-6: 

p\ishingiP,OJ{)  mP=0  or  exist  (0^=P,02,  ■  ■  •  0„=0)  [  direct_push  (0,,0,+i,W)  ] 
Object  A  directly  pushes  B  throughout  H  if  in  any  sufficiently  small  subhistory,  A  is  moving 
into  B'i  space.  Formally 

DeflnltioD  9-7: 

direct_push(A,5,//)  iff 
forall  (Hi)  [  subhistory (//j,^  implies 

exists  (//j)  [  subhistory(//2//)  and 

overlap(place{y4  ,tndscent(H^) ,place(S  ,startscene(//2))  ]] 
Together  with  the  "hard_objects"  constraint,  the  "push_driven"  constraint  guarantees  that 
objects  will  move  if  and  only  if  the  something  pushes  on  them,  and  that  push  originates  with  ani- 
mate objects.  The  direction  in  which  the  pushed  object  moves,  however,  is  left  open,  as  long  as  it 
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moves  out  of  the  way  of  the  pii&her.  A  complete  analysis  of  the  response  to  piishing  is  probably 
impossible  without  a  Newtonian  force  analysis,  together  with  a  theory  of  friction. 

In  many  cases,  we  must  supplanent  the  simple  theory  given  above  by  a  simple  theory  of 
gravity.  We  do  not  wish  to  in^xnt  the  theory  of  gravity  as  universal  attraction,  or  even  as  a  uni- 
form constant  force  field.  Rather,  we  are  only  interested  in  the  interaction  of  gravity  with  con- 
troUed  motions.  We  cannot  ignore  falling  altogether  --  something  has  to  happen  when  you  push  a 
vase  off  a  table  •-  but  we  treat  it  as  an  arbitrary  motion  with  a  downward  component.  For  our 
purposes,  gravity  imposes  two  constraints  on  histories,  one  negative  and  the  other  positive.  Rrstly, 
no  object  moves  unless  one  of  the  foUowing  is  true:  the  object  is  animate;  the  object  is  pushed;  the 
object  is  carried;  or  the  motion  is  downward. 

Secondly,  all  objects  move  directly  downward  if  it  is  not  supported.  A  supported  object  may 
move  downward  if  it  can  push  the  support  out  of  the  way,  or  if  it  can  roll  out  of  the  way. 

Note  that  this  account  ignores  inertia,  both  upward  and  horizontal.  The  second  constraint 
disallows  both  throwing  an  object  up,  and  having  an  object  fly  off  a  surface  in  a  horizontal  direc- 
tion, because  it  would  be  an  unsupported  object  which  is  not  moving  directly  downward.  In  fact, 
there  is  no  way  to  introduce  inertia  into  the  system,  and  still  disallow  objects  from  spontaneously 
starting  to  move  upward,  without  dther  adding  velocity  as  a  state  variable,  or  making  constraints 
history  dependent.  The  physics  described  by  the  above  constraint  are  basically  those  of  slowly 
moving  objects  in  a  viscous  medium  which  absorbs  any  inertia  -•  snails  pushing  blocks  in  a  sea  of 
liquid  Prell. 

We  define  downward  motion  in  terms  of  the  center  of  mass.  To  simplify  our  theory,  and  to 
allow  it  to  encompass  cases  where  the  distribution  of  mass  is  unknown,  we  assume  about  the 
center  of  mass  only  that  it  is  some  point  within  the  convex  hull  of  each  object. 

There  is  a  difficulty  in  defining  carrying.  What  we  would  like  to  say,  intuitively,  is  that,  if 
object  O  supports  object  P,  and  object  O  moves,  then  P  will  move  along  with  it,  if  it  possibly  can. 
However,  this  formulation  is  non-monotonic,  since  it  relies  on  the  non-existence  of  a  proof  that  P 
will  be  prevented;  and  non-monotonic  axioms  are,  in  general,  to  be  avoided.  There  are  two  ways 
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of  stating  the  axioms  monotonically:  either  that  P  must  move  along  with  it,  or  that  P  may  move 
along  with  it.  The  first  formulation  is  definitely  too  strong.  K  P  must  move  with  O,  then  O  cannot 
move  without  P.  From  this  we  onild  deduce  that  even  if  some  other  support  caught  hold  of  P  still 
O  could  not  get  away  from  P .  We  must,  therefore,  adopt  the  second  formulation  and  live  with  the 
fact  that  our  physics  does  not  give  us  any  assurance  that  objects  we  have  placed  on  a  horizontal 
surface  will  stay  there  when  the  surface  is  moved. 

We  need  five  primitives  to  define  these  constraints  formally.  The  first  b  up,  which  is  a  direc- 
tion. We  will  associate  z  with  the  up  direction,  and  x  and  y  with  the  horizontal  directions.  The 
second  is  the  ground.  The  ground  is  an  immobile  object  which  extend  indefinitely  far  down  from 
its  surface.  Axiom  9-1  expresses  the  latter  condition. 

Axiom  9-1: 

forall(jo')  exists(zc)  forall  (z<rQ)  <x^^>t  stand(ground) 

Up  and  ground  are  constants  of  the  theory.  Center-cf-mass  is  a  function  from  objects  to  a 
point  in  P}.  We  locate  the  center  of  mass  with  respect  to  the  standard  position  of  the  object.  It 
satisfies  the  following  axiom: 

Axiom  9-2:  forall(O)  center-of-mass(O)  e  convex-hull(stand(0)). 

Fmally,  we  need  two  support  predicates:  direct_fupport{B ,C),  meaning  that  body  B  directly 
supports  body  C;  and  ground_supported{p  JS),  meaning  that  O  is  ultimately  supported  by  the 
ground  in  scene  S.  These  are  defined  as  foUows: 

Definition  9-8: 

B  directly  supports  C  iff  there  exists  a  vertical  line  L  and  a  point  p  on  L  such  that ;?  is  on  the 
boundaries  of  both  B  and  C,  and  there  exists  a  small  open  interval  of  L  bounded  below  by  p 
which  is  in  the  interior  of  C,  and  there  exists  a  small  open  interval  of  L  bounded  above  by  p 
which  is  in  the  interior  of  B . 

This  is  clearly  a  very  weak  definition  of  "direct-support".  It  allows  B  to  support  C  even  if 
they  meet  only  at  a  single  point,  or  even  if  they  meet  along  a  very  steq)  face.  However,  the  con- 
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straints  above  which  involve  support  are  also  qiiite  weak.  It  may  be  noted  that  the  idea  of  a  stable 
support,  wiiidi  holds  the  center  of  mass  in  a  local  minimum,  is  biiilt  into  the  gravity  constraints. 
The  main  weakness  of  our  definition  of  direct  si^jport  is  that  it  does  not  distinguish  between  sup- 
ports which  are  labile  and  those  which  are  completely  unstable,  but  this  is  a  somewhat  subtle  dis- 
tinction for  many  purposes. 

Now,  we  can  define  "ground_supported",  as  the  transitive  closure  of  "support",  terminated 
by  the  ground. 

DeflnltioD  9-9: 

ground_!upportedip Ji)         iff         ejost         (0^= ground, O2,  ■  •  ■  0„=0)         such         that 
direct_fupport(0,  ,0^ + 1  yS) 

We  are  now  in  a  position  to  define  the  gravity  constraint.  We  will  piece  it  together  out  of  a 
number  of  separate  constraints.  Stationary_ground  states  that  the  ground  stands  still. 

DeflnitioD  9-10: 

stationary- ground    ■     {    //     |    ground    e     objects    (I^    and    forall     (5e     scenes(^)) 
scenemapping(gound,5)=/,  where  /  is  the  identity  mapping. 

Must_fall  is  the  constraint  that  unsi^jported  objects  fall. 

DeflnitioD  9-11: 

must_fall  " 

{  H  I  forall  (Ocobjects(//),  H^) 

[[subhistory(//i/f)  and  not  instantaneous  {H^]  implies 

[ground-supported(0,startscene(Wi))  or 

exists  (f/j)  [  initia](ff2^i)  and  fallsCO^/Zj)    ]]  } 
Must_fall  uses  falls(0,f/)  as  a  predicate  meaning  object  O  during  history  H. 

DeflnitioD  9-12: 

fal]s(O/0  iff  exists(fc>0)  cm-translate(0,H)=-fe. 
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We  now  state  the  constraint  that  no  object  move  upwards  spontaneously. 
Deflnhkni  9-13: 

no_up  " 

{ H  I  foral](0£objects(f/)) 

movesin(0^  implies 
easxiH^Ji)  [subhistory(//i^  and  dn\e&[R,OM)  and  animate(/?)  or  falls  (R,  H)]]  } 
"Drives"  is  defined  analogously  to  "pushing"  above.  P  drives  $0  if  there  is  a  chain  of  objects 
from  f  to  O  such  that  each  either  pushes  or  carries  the  next. 

DefinitioD  9-14: 

dnse&iP,OM)  iff  P=0  or 

exist  (0^=P,02,  ■  ■  ■  0„=0) 

[  direct_push(0;,0,+i^  or  direct_carry(C>;,0,+i//)] 
Definition  9-15: 

direct_carry(0^^)  iff  forall(5€Scenes(//))  direct_support(0^^) 

Fmally  we  can  define  the  gravity  constraint: 

DeflnitioD  9-16: 

gravity  ■  hardobjs  (~)  stationary_ground  P)  must_fall  H  no_up 

10.    CODChlsiODS 

The  systwn  presented  develops  an  integrated  set  of  axioms  for  the  following  domains: 

1)  The  naive  physics  of  rigid  objects,  in  cases  where  neither  time  nor  force  has  to  be  quanti- 
fied; 

2)  Physical  actions,  physical  feasibility,  and  action  descriptions; 

3)  Sensors  and  qjistemic  feasibility 

For  many  important  problems  in  robotics  and  naive  physics,  such  as  those  listed  in  section  1, 
these  domains  will  suffice.  We  can  formally    describe  these  problems  in  the  terms  we  have 
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developed.   Papen  in  preparation  will  describe  a  robot  programming  langiiage  based  around  these 
ooncqns  and  a  study  of  the  geometrical  primitives  needed  in  this  domain. 
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